| min rank | avg. rank | sentence |
|---|---|---|
| 5143 | 14507.3077 | Disebut Pandai 'Akting' Fakta Sikap Asli Lina Dibongkar Asisten Pribadi, Terbukti Sule Diselingkuhi! |
| 4484 | 15245.1250 | RESENSI BUKU : Cerdas Mengelola Gaji Menjadi Investasi - Koran. |
| 4452 | 16150.8750 | Resep Nila Bakar Pedas Manis Yummy, Yuk Coba! |
| 3440 | 14214.6667 | Cari Jawaban kenapa Suhu Udara Kelewat Panas, Netizen Kepoin… |
| 3024 | 28682.5714 | “Temennya lari bawa gayung dalemannya melorot anjir. |
| 2643 | 11027.9000 | Kumpulan Ucapan Selamat Idul Fitri 1440 H/2019, Cocok Dibagikan… |
| 2467 | 18555.7143 | Garda Revolusi Iran Nyatakan Siap 'Habis-habisan' |
| 2440 | 17942.4286 | David Ospina, kiper Napoli, menyelamatkan gawangnya. |
| 2387 | 10665.5000 | Keren ala Bunga Citra Lestari, Cantik Maksimal! |
| 2166 | 9872.0000 | Mahkamah Kalkulator Vs Mahkamah Keadilan! |
| 2107 | 19073.7000 | Ide Nama Unik Bayi Laki-laki Bahasa Sansekerta Urut Alfabet,… |
| 2107 | 9066.6667 | Pengakuan Agnez Mo, Kenapa Nama Belakang Ayah "Muljoto" |
| 2093 | 12486.2143 | Toyota Agya Tipe G Manual 2015 Putih Bekas Bagus Mulus Plat F BBM… |
| 1970 | 9286.5714 | Kalo tdk paham silahkan tanya MUI," tulisnya. |
| 1938 | 11377.6667 | Sindir Farhat Abbas, Nikita Mirzani Tunjukkan Total Belanjaan Barang Mewah: Mana Belanjaan Loe? |
| 1933 | 14512.5714 | JEJARING SOSIAL : Mengenal Penggunaan Data Twitter - Koran. |
| 1883 | 6111.0000 | Personel Satlantas Polresta Barelang meninjau Tempat Kejadian Perkara (TKP). |
| 1844 | 20811.4000 | Keringatnya bercucuran, bikin body-nya seksi. |
| 1830 | 21580.5556 | Kawasan Berikat Nusantara (KBN) Persero, H.M Sattar Taba. |
| 1784 | 18356.5000 | CEO Multi Inti Digital Bisnis (MDB) Subhan Novianda. |
| 1751 | 4288.7500 | Betrand Peto Siap Masuk Sekolah, Ruben Onsu Beri Fasilitas Mobil… |
| 1712 | 13402.8750 | Biar Doa Cepat Dikabulkan, Kenapa Orang Seringkali Bernazar? |
| 1712 | 9524.4167 | Vanessa Angel Menikah Tanpa Minta Restu Orang Tua, Doddy Sudrajat… |
| 1619 | 11983.0000 | ''Atasan'' Penusuk Wiranto Ternyata Telah Ditangkap Densus 88… |
| 1582 | 13986.5000 | Lagi, Apple Bajak Ahli Kecerdasan Buatan Google - Tekno Liputan6. |
| 1522 | 15382.0000 | Kondisi Dylan Carr diungkap rekan seprofesinya, Angela Gilsha. |
| 1501 | 24584.5455 | Kulo mboten nyongko angsal parcel lebaran ngeten Niki, istimewa banget pak. |
| 1459 | 15570.3333 | Digerebek, Petugas Tangkap Basah Terapis Spa Beri Layanan "Plus" |
| 1430 | 9427.1667 | Sebagaimana dilansir Saudi Gazette, Ahad (16/6). |
| 1381 | 19340.1250 | Emang harusnya tetep beliau sih, supaya tercontinue programnya. |
In contrast to subsection 4.5.2.1 we now search for sentences consisting of rare words only. The sentences are ordered by the rank of the most frequent word in a sentence. In the table, we see the corresponding sentences with a minimum length of 40 characters.
The sentences are forced not to contain any everyday word. As a consequence, we get either sentences of some very reduced structure or sentences in some foreign language. Hence, the data are useful for the evaluation of the preprocessing, especially language detection.
select min(w_id)-100 as m, avg(w_id)-100 as a, s.sentence from sentences s, inv_w i where s.s_id=i.s_id and length(sentence)>40 and i.w_id>100 group by s.s_id order by m desc limit 30;
Should we remove the sentences having its least frequent word above some threshold?
4.5.2.1 Maximum word rank in sentence
4.5.2.2 Average word rank in sentence
4.5.2.4 Sentences consisting of many low frequency words II
4.5.2.5 Sentences consisting of short words only I
4.5.2.6 Sentences consisting of short words only II
4.5.2.7 Sentences consisting of long words only I
4.5.2.8 Sentences consisting of long words only II